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1,0 IN'i'HODUCTION 

Discrete Tohebyoheff orthonormal polynomials offer a convenient way to mke 
least-squares polynomial fits of uniformly spaced discrete data. Computer pro 
grams to do so are simple and fast, and appear to be less affected by computer 
roundoff error, for the higher order fits, than conventional least-squares 
programs . 

P. Tohebyoheff, a Russian mathematician, developed these polynomials about 100 
years ago.^ Their application to modern computer technology is very germane, 
but few people know about them. They are useful for any application of polyno 
ralal least-squares fits; approximation of mathematical functions, noise anal- 
ysis of radar data, and real time smoothing (filtering) of noisy data, to name 
a few. 

Uniformly spaced, discrete data, as shown below 


JiH. 

« 

yi 

tt 

yz 


« 

yN 


n 

xi 1 

xp 2 

* • 

XN N 


has an Ith order least-squares polynomial fit 
y(n) = Ao'fo^n) + AiTi(n) + AgTpCn) + 


given by 

A 

■ ' + AiTj;(n) 


( 1 . 1 ) 


whore the Tj^(n) are the discrete Tchebycheff orthonormal polynomials of n. 
The A; ooefflcien'.s are called the Fourier coefficients and are gJ /en by 


' «_ 

Ai = SynTt(n) (1.2) 

n=1 


*Erdelyl, A., ed.: Higher Transcendental Functions , volume II, McGraw-Hill 

Book Company, 1953, section 10.22. 
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A simple recursion formula is used to generate the T^^(n) polynomials. Note 
an important fact: the Aj[ coefficients are independent of the order of the 

A 

polynomial fit. That is, an I 1 order fit uses the same values of A^ as 

A 

an Ith order fit, only the A 14.1 Ti^^(n) term ia added to increase the fit order. 
Let 

y* = yn + 0.3) 


where y^, is the error-free value of y, and is the error (noise) adding 
to y|^. Equations will be developed to estimate the statistics of c, and equa- 
tions will be derived showing how accurately y^ and its derivatives can be 
predicted. 

When is highly correlated, a surprising result is shown. The fit polyno- 
mial at the end points of the fit can be less accurate than the raw data. Thi.'i 
newly discovered information bears reemphasizing. There are instances where 
the raw (noisy) data is more accurate than that of the polynomial fit (filtered) 
data* 


2.0 THE DISCRETE TCHEBYCHEFF POLYNOMIALS 

First shown will be a set of Tchebycheff orthogonal polynomials. 

To = 1 

Ti = 1 + aiin 

Tg = 1 + agin + aggn^ 

T3 = 1 + 3310 + 33gn2 + 3330^ 

Ti = 1 + 3iin + aign^ + ai3n3 + ••• + aiin^ 

The scalar product of the two variables f(n) and g(n) is defined by 


N 

(f, S) = Sf(n)g(n) (2.1) 

n =1 
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Since the polynornialfl are orthogonal, then by definition 


(Ti, Tj) s 0 for i ^ d (2.2) 


This equation may be used to determine the aij coefficients. That is 


N 

STi(n)Tj(n) 5 0 i ^ J (2.3) 


Note; the original discrete Tchebycheff polynomials used a summation of 
n s 0 to rt s N - 1 , op oit. 

It has been determined that the norm of is given by 


(Ti, Ti) 


N (N - 1)(N - 2)‘-*(N - i) 

2i + 1 (N + 1)(N + 2)--«(N + i) 


(2.«0 


The orthonormal polynomials are given by 

Ti = Ti/V(Ti, Tji) (2.5) 

where 

Ti - aio Sitn + aign^ + ai3n3 -f * • • + ai^ni (2.6) 

Note that 


(Ti, Tj) = 0 for i it j 


si for i = j 


The first eight sets of the aij coefficients are shown as follows. 


3 
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S51 


352 


^53 


agi) 


^55 


361 


862 


263 = 


3611 = 


,, 15N'* + 105N3 + 365N2 + 525N + 27H 
(N t 1)(N ♦ 2)(N ■»• 3)(N 4 H)(N + 5) 


= 210 


n3 + 1in2 + 8N + S 


(N 4 1)(N + 2)(N + 3)(N + IJHN + 5) 


= -IHO 


HN2 + 9N + 8 


(N + 1)(N + 2)(N + 3)(N + 1|)(N 5) 


s 630 


N + 1 


(N + 1)(N + 2)(N + 3)(N + l|)(N + 5) 


252 


(N + T)(N + 2>(N + 3)(N + 11)(N + 5) 


jj, n 5 + lON^ -f 55 n3 + IIIONS + ri8N + SH 
** (N + 1)(N + 2)(N + 3)(N ->• 10 (N + 5)(N + 6) 


; 1|2 


lON^ + 60N3 + 215N2 + 315N + 178 
(N + 1)(N + 2)(N 4- 3)(N + 10(N + 5)(N + 6) 


-1120 


11N3 + 15 n 2 + 32N -»• 21 


(N + 1)(N + 2)(N + 3)(N + 4)(N + 5)(N + 6) 


210 


15N2 + 33N + 32 


(N + 1)(N + 2)(N + 3)(N + 11)(N + 6)(N + 6) 


N + 1 


(N + 1)(N + 2)(N + 3)(N + 4)(N + 5)(N + 6) 


365 = -2772 


II 
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(N ■¥ 1)(N + 2)(N + 3)(N •»> »4)(N -f 5)(K * 6> 


14N^ + i89N5 + ISOSN** 5880N3 + 13223N2 + 14847N 6534 

(N + 1)(N + 2)(N + 3)(N + 4)(N + 5)(N + 6)(N + 7) 


18n5 + 150N*< 835N3 + 2100N2 + 2811N * I4l4 

(N + 1)(N + 2)(N + 3)CN + 4)(N 5)(N + 6)CN + 7) 


50N^ + 275N3 + 1030N2 + 1540K + 937 
(N + 1)(N + 2)(N + 3)(N 'J* 4)(N ■¥ 5)(N + 6)(N + 7) 


5N3 + 18n2 + 41N 28 

(N + 1)(N f ‘i)(N 3)(N -f 4)(N 5)(N + 6)(N + '7) 


18n2 + 39N + 41 

(N 1)(N + 2)(N + 3)(N + 4)vN + 5)(N -f 6)(N + 7) 


N + 1 

(N + 1)(N + 2)(N + 3)(N + 4)(N + 5)(N + 6)(N + 7) 


(N + 1)(N + 2)(N + 3)(N + 4)(N + 5)(N + 6)(N + 7) 


6n7 + 105N^ + 114 1n5 + 6300N^ + 21763N3 + 42399n 2 + 44158N i 1f?h’i 
(N +1)(N + 2)(N + 3)(N + 4)(N + 5)(N + 6)(N + 7)(N + 8) " 


210n6 + 2310 NS + 18375N^ + 69300n3 + 160951N2 + 1871ION + 88316 
(N + 1)(N + 2)(N + 3)(N + 4)(N + 5)(N + 6)(N + 7)(N + 8) 


6 


1 
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083 


-'1620 


2N5 + 15N'< + 86n3 + 216N2 + 305N + 162 


asu s 2310 


8015 s -3603'» 


806 s 12012 


307 = -SI^ISO 


(N ^ 

D(N 

+ 2)(N 

■f 3) IN 

4 lOC N ■< 

^ 5)CN 4 

6)(N 

4 7)(N 4 6) 



15N‘< 

+ 78n3 

4 307N2 

4 weN 

4 305 


(N + 

DCN H 

K 2)(N + 3)(N H 

h D(N + 

5)(N 4 

6)(N H 

K 7)CN 4 8) 




2N3 + 

7N2 4 17N 4 12 



'(N + 

D(N 

+ 2)(N 

4 3)(N 

+ DCN ^ 

^ 5)CN 4 

6)CN 

4 7)CN 4 8) 




7N2 + 15N 

4 17 



(FT 

DCN 

+ 2)(N 

4 3)(N 

4 4)(N •* 

• 5)(N 4 

6)CN 

4 7)CN 4 8) 





N 4 1 





388 = 


(N + 1)(N + 2)(N + 3)(N + '0(N + 5)(N + 6)(N + 7)(N + 8) 
12870 

(N + 1)(N~+ 2)(N + 3)(N + 'IKN + 5)CN -f 6)(N + 7)(N + 8) 


Note that all the odd order polynomials in the numerators of the above ooeffi- 
oients have a facti r of N + 1, 

Several interesting relationships oonoerning the a^j ooefficients have been 
observed. Some of them are 


Ti(1) = 1 + aii + ai2 + + aii s 


(N - DCN - 2)***(N - i) 


(2.7) 


l’i(N) = 1 + ai|N + 8^2^^ +. • • • + = (-1)^ 


(N + 1)(N + 2)*“(N + i) 

(N - 1)(N - 2)--(N - i) 
(N + DCN + 2)'“(N + i) 

( 2 . 8 ) 
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For i odd, the midpoint value of Ti ia 



N f 1 

s 1 -f ail -Y~ + HZ 


(^) 


* aii 


f-i") 


e 0 


(2.9) 


For i even® 



1 X 3 X 5 X ••• x(i - 1) (M - 1)(N ~ 3)***(N~(i - 1)) 
2 X *1 X 6 X X i (N + 2)(N + + i) 


( 2 . 10 ) 


Other, more complex relations are shown below. Let 


(N + 1)(N + 2)-*(N + i) 
a*in ^ ■ — I II II ■ . ■■ ■ ■■ V I M .. — s 

(N + 1)(N + 2)-"(N + i) 


®ij = ®ij with N s -N In the numerator. 


The for k a 0, 1, 2, i 


i ji 


J?k (J - Wl 


NJ-Kaij = klalk 




(2.11) 

( 2 . 12 ) 


(2.13) 


(2.1in 
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Prom these two equations, it is easily seen that 




Also observed were the two important relationships 

2^ ai_i i_i 

aii = - -(2i - 1) — — 

i N + i 


ai,i-l = - -(N + Daii 


The Ti(n) polynomials have the following symmetry properties about 
n = (N + D/2. 






Other interesting relationships are 


(nJ, Ti) = = 0 for 0 1 j < i 

n=1 


N 

SniTi 

n=1 


1 (N + 1)N(N - 1)(N - 2)‘--(N - i) 
aJTiTi (N + 1)(N + 2)*-*(N + i + 1) 



n^+^Ti = 


1 

3i+1,i+1 


(N + 1)N(N - 1)(N - 2)--*(N - i) 
(N + t)(N + 2)---(N + i + 1) 


Note from equation 2.19 that (i ^ 0) has an average value of zero. 
The relationship to Legendre polynomials is shown below. Let 


(2.15) 


( 2 . 16 ) 


(2.17) 


( 2 . 18 ) 


(2.19) 


( 2 . 20 ) 


( 2 . 21 ) 
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n « -(x + 1) 
2 


( 2 . 22 ) 


Then for N 


Tj.(n) '► (-l)l-Pi(x) 


(2,23) 


where the Pi(x) t<re the well known Legendre polynomiaXa. 
The eqvmtlona for Tq through fi|(n) are shown below, 


•I'., - 


•i’o 


ViT 


(2.210 


* siz 1 

T|(n) S V> >f 1 - 

^ Vfja - 12 


(2.25) 


\Ih 1 

f;j(n) a V - T — “ T + l)(N 4- 2) - 6 (N 4- Dll 4- CuiS) 

Vn VcN^ - - 2^ 

(2. 26) 


f-5(n) 


yiT yfp"'- i5)(n2'T'^)(nS - 3fl) 

- 2(oN^ 4- 15N 11 )n + 30(N -f Dr)S - aon^) 


[(N 4- 1)(N 4- a)(N 4- 3) 


(2.27) 


^ (N 4-1 )(N 4- D)(M 4- 3HN 

yN » 1-)(P - p^Dcn* - 3S)(N^ - i|‘-) 


4 - 10 


10(2N3 ■». 9K- 4. 1YN c KOn 4- 10(9N^ 2TN 4- 1?)n2 


- 1110 ( N 4. 


?On'l] 


(2.88) 


Plots of T’o fclirough Ti|(n) are shown in figure 1. The value of N wna 119. 
Note the syniiiietry about the midpoint of n a (N 4- 1^/2 a 60. Also note, from 
equation 2.19, that for i ^ 0 the moan value of Ti(n) is zero, 


10 
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3.0 RECURSION EQUATIONS 

The recursion equations are the- best way to generate the Tchebycheff polyno- 
mials and the aj,j and aj,j coefficients. 


Ti(n) = 


1 


■((2i - 1)(N + 1 - 2n)Ti_i(n) 


i(N + i) 

- (i - 1)(N + 1 - i)Ti.2\?’J3 


(3.1) 


where 


To(n) = 1 


(3.2) 


Ti(n) = 1 - n 

' N + 1 


(3.3) 


The recursion relationship for the Tchebycheff orthonormal polynomials, Tj^(n), 
is given by 


To = 1 /Vn 


(3.4) 


Tl 


= (l - -i-nU 

V N 4- 1 /\l 


3(N + 1 ) 
N(N - 1) 


(3.5) 


Si 




4i^ - 1 

n 2 _ i.2 


(3.6) 


Ti(n) = Si [(N + 1 - 2n)Ti„-|(n) - -~Lfi.2(n)] 


(3.7) 


12 


To generate the aij ooeffioients in 

Ti(n) = aio + aiin + ajL2n2 + ••• ♦ anni 

use 


8li0 = 1 


1 * 0 , 1 , 


Hi 


2(ai - 1) 
i(N + i) 


i = 1» 2, 


Si, 1-1 


-CN + Daii 


i 


“2, 3f 


• t a 

f 


^ -■ ■] ■ ) ( ^21 - 1)((N + 1)ai,i,j - 2ai.T,j.v) 

- (i - 1)(N + 1 - i)ai_2,j) 

where 1=3, I and j = 1, 2, 2. 

To generate the 3^ coefficients in 

Tj^(n) = a^o + aiin + a±2^^ + ••• + a^^n^ 

use 



J, 


^j2 - 1 
n 2 - i2 


i = 2, 3, 


* • • f 



fum 

aio s 


3(N ♦ 1) 
N(N - 1) 
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(3,16) 


2 - 

ail s « — ain 

'' N + 1 


(3.17) 


aiO 


-4 


*2i + 1 (N + 1)(N + 2)-**(N i) 
N (N - 1)(N - 2)***(N - i) 


i = 2, 3, I (3.18) 


aii = "2Si ai_i,i-i 


i s 2, 3, •••, I (3.19) 


= - -(N + 1)3ii 


i = 2, 3, I (3.20) 


aij = Si [(N + 1)ai_l,j - 2ai.i j_i - g^ai.2,j] 

for i = 3 , 4 , • • • , I and js1,2, ••*,i-2. 

Let 


(3.21) 


dfi 

T|(n) = — (3.22) 

^ dn 


The reoursion relationship for the first derivative is obtained by differen- 
tiating equation 3.7. 


T|(n) = Si [-2Ti„i + (N + 1 - 2n)Ti_-|(n) 



(3.23) 


The following interesting relationships can be obtained for derivatives. 


80FH19 


For i Qvan, 


N d*<Ti 

y s 0 for k * 1, 3, 5, 7, ••• (3.2*0 

nsi dn** 


For i odd , 


N d>«Ti 

T — ~ = 0 for k = 0, 2, *♦, 6< ••• (3.25) 

nsi dn*^ 


H.O LEAST-SQUARES FITS AND ACCURACY 

Consider a uniformly spaced set of data to be fit, y*, as shown below. 


X 

n 

Jit 

i 

XI 

1 

yi 

• 

X2 

2 

V2 

• 

t 

• 

• 

• 

•- 

• 

• 

t 

« 

XN 

N 

yN 

where Ax s Xi 

“ Xi- 

-| is constant, and 


! n s 


X - XI 

"TT 


+ 1 I 


For an Ith order polynomial fit, let 


J ^ />> A I 

! yn = AqTo + + AgTg + + AjTi ! 

I _l 




(H.2) 


15 
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where 



(4.3) 


are called the Fourier coefficients. As will be seent this will result in a 
conventional least-squares fit. 

The residual is defined by 


I • ^ • 

* = Vn - Vn • 

! I 


For a least-squares Tit, the are chosen such that 


N 2 

2 r^j s 0 is minimized 
n^1 


That is, 


2^ 

Ui 



for i = 0, 1, 2, ••*, I 


(4.4) 


(4.5) 


16 


0OFM19 


It is easily seen that 



A " • » A n t~ 

- 2Ao I yn To - 2Ai ^ yr,Ti 
n=1 n*1 


A a 

- 2Ai I YnTi 
n=1 


Differentiating with respect to Ai gives 


5 •“ 

2Ai - 2 N y„Ti = 0 
ntl 


(4.6) 


(4.7) 


A 

which yields equation 4.3 for A^. 

An interesting aspect of a least-squares fit is that 


N 


I/n = 

n=1 


0 


This is seen from 


(4.8) 



SAi n=1 n=1 3 A^ n=1 aAj, 


(4.9) 


17 
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or 


I N 

I Sf’nTi(n) s 0 

I n:1 


i s Oj 1| 2f ***t I 


(4,10) 


But Tq is the constant l/VH, which will factor out. Henoe, the sum of the 
residuals will be zero. Equation 4.10 indicates that the Fourier coefficients 
of the residuals will all be zero, That is» an Ith order polynomial fit of the 
residuals will be zero, and so will an I - 1 order fit, an I - 2 order fit, etc. 

The values oan be represented as 


! « I 

• yn = Fn + • (4.11) 

! 1 


where is the error-free value and is the error (noise) adding to yn. 
It will be assumed tht mean. That is, the expected value of 

is 


E(en) 5 0 


(4.12) 


The autocorrelation function of Sn defined by 
h = E(enen+i) 


(4.13) 


<{>i is assumed independent of n, stationary process, and <|>j_ will be 
symmetric. 




(4.14) 


The standard deviation of is defined by 




(4.15) 
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If the error* is ’•unoorrelated" in time, then 

s 0 for i )l 0 (^»16) 

The Fourier ooeffioionts of c are given by 


N I 

El = I e„Ti(n) I 

nsfl i 

l( l ll . -J 


(4.17) 


With a little effort, it can be shown that 


N-1 N-k 

E(EiEj) s + 2^kl (Tl(n)Tj(n k) + Tj(n)fi(n + k)) 

k=1 nsl 


(4,18) 


where 


a 1 for i a j 

a 0 for i ^ j 

Note that for unoorrelated noise 

E(Ei^) = cr,.2 (11,19) 

E(EiEj) a 0 for i >< j (4.20) 


It will be assumed that is adequately represented by the 1th order polyno- 
mial 


yn = AqTo + Aif-| + A2T2 + ••• + AiTj 


(' 1 . 21 ) 


19 
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where 


N 

H * SynTl(n) (^•22) 

n*1 

’’Adequately" means that the error In equation 4.21 is small compared to o^. 

■ 

The Fourier coefficients for were 

H = iynTi(n) 
n*1 


But yj s yp + en» 

H * h + Ei (4.23) 

And 

yn * AqTo ♦ AiTi + *•• + Ajfi 

becomes 

yn = yn + EqTo + Elf-) + E 2 T 2 + ••• + Elf I (4.24) 

The mean value of the error In is easily seen to be 

E(yn - yn) = 0 (4.25) 


The variance of the error for an Ith order fit is 


I Hlyn - yn>^] = I Ti2e(Ei2) . S I YTiii»jE(EtEt*j) 
I isO js1 IsO 


(4.26) 


20 
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Por unoorrelatod noise, equations 4.19 and 4.20, 


E((yn - Vn)^) 


* IV I 

UO I 
I 


(4,27) 


From equations 2.4, 2.7 and 2.8, the endpoint values of are 


V(1) * V(N) 


2i 1 (N - 1)(N - 2)»'»(N - i) 
” (N 4 - 1)(N + 2)‘*‘(N 4 i) 


For N large and n s- 1 or N 


(4.28) 


E((yn - yn)^) - + 3 + 5 + 7 + (21 


(4.29) 


or 


! E((y-| - yi)^) = E((yn “ yw)^) * (^ I 

! ! 


(4.30) 


where I is the order of the fit. 

From equations 2.4, 2,9, aid 2.10, for the midpoint value of n s (N + T)/2 




f4^)- 


0 for i odd 


(4.31) 




for i = 0 


(4.32) 
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And for i tven 




( N + A 2i ♦ 1 /l 


X 3 X 5 X ••• X (i - 1) 


2 X 4 X 6 X * * ' X i 


■J 


(N2 - 1)(n2 - 32)”'(M2 - (1 - 1)2) 
(N2 - 22) (n2 - A2)...(n 2 - l2) 


For N large and n * (N + 1)/2 


E((yn - Vn)^} * [l + 0 


5 81 2925 

+ r + 0 + rr+0 + 

4 64 2304 


1 = 0 1 


2925 T 

2304 ] 

6 


The residual is r^ - y* * yn* Substituting equations 4.11 and 4.24 
yields 


=* en - ^oTo - Eif ^ - EgTg - • • • - Eifj 


The sura of the residuals squared is 


I = I en^ - 2 2 * EiCnfi + -• EienTi) 

n=1 n=1 nsl 


N 

t T (EoTq + EiTi + Egfg + ••* + EiTi )2 
n=1 


(4.33) 


(4.34) 


into this 


(4.36) 
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(4.39) 


where, from equation 4.1 


dn 1 
dx Ax 


(4.40) 


Assuming unoorrelated noise 


E 





(4.41) 


where dTo/dn s 0. 


In general, for unoorrelated noise 



(4.42) 


Figures ' through 5 show the aoouraoies of yn and dyn/dx versus N for 
unCiorr'j.ated noise for n s 1, N and (N + 1)/2. Figures 6 and 7 show the 

aoouraoies of y^ and dyn/dx versus n for unoorrelated noise for N = 99. 
The figures are graphically informative. Clearly the midpoint estimates of 

A A 

and dy^^/dx are much more accurato than the estimates at the end points* 
Also at the midpoint value of n » (N + 1)/2, it is seen that the accuracy of 

yn is the same for 1 s 0 order fit and Is 1, I s 2 and I s 3, I s 4 and 
I s 5, etc. The reason for this is interesting. Let 

A 

^yn s estimate using Ith order fit 


8orM19 


Then for n * (N + 1)/2 


1 iy(N+1)/2 ® I+I^CN+D/a 1 = 0, 2, 4, 


A I A 

Likewise for the midpoint derivative = dyn/dx 


! I^(N+1)/2 * l+1^(N+1)/2 I = 1, 3, 5, 


The extension to higher-order derivatives is easily seen from the above. 




VO m ^ 


ro CM 


2/U * N) . U - [;(“< - ^)]3^ 








Accuracy of y at midpoint of fit versus 



















CsJ 
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5.0 CORRELATED N0J.3E EXAMPLES 

Correlated noise vastly coraplioates the aoouraoy equations. In this seotion, 
exponentially oorrelated noise will be considered when using a second order fit 
with N = 101 points. A comparison of the fit accuracy will be made with the 
uncorrelated noise case. The autocorrelation function of exponentially 
oorrelated noise is given by 


4>k * Og^a^ B E(G{|en+k) (5.1) 


where 


0 < a < 1 


Let 


k'^ij = S.(Ti(n)Tj(n + k) + Tj(n)fi(n + k)) 
n*sl 


( 6 . 2 ) 


From equation 4.18 


E(EiEj) 


= Oc 


2 N :: '' 

^ij + ^ 

k=1 


k'^ij 


(5.3) 


For a second-order polynomial fitj the following can be shown after some ef- 
fort . 


2 

k^OO = -(N - k) 
k'^dl = k'TlO * 0 


k^OS = k^ao 


Zyfs (N - k)k 
N V(n2 - 1)(n2 - 4) 


.(N - 2k) 


(5.4) 

(b.b) 

(5.6) 
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2 N - k, o 

kTlI - - -r (n 2 « 1 - 2(N ♦ k)k) 

N n2 - 1 

(5.7) 

kTl2 * kT2l = 0 

(5.8) 

2(N - k) > ^ 

kT22 = — — — ((n2 - i)(n2 - 4) 

N(n2 - i)(n2 - 4) 

(5.9) 

- (4n 2 - 10) (N + k)k + 6(N + k)k3) 

For a 5 0 (unoorrelated noiae) 


E(Eo2) s Og2 

(5,10) 

e(Ei2) s OgS 

(5.11) 

E(E22) = 0^2 

(5.12) 

E(EqE2) 5 E(E2Eo) s 0 

(5,13) 

E(EoEi) = E(EiEo) = E(EiE2) = E(E2E0 = 0 

(5.14) 

following results use N = 101. 


For a = 0.4 


e(eo2) s 2.3113 31133 0e^ 

(5.15) 

e(e>|2) = 2.2673 55119^ 0^2 

(5.16) 

E(E22) = 2.2234 65949 Og2 

(5.17) 

e(EoE2) s e(E2Eo) = -0.045873 81831 0^2 

(5.18) 

E(EoEi) = E(EiEo) = E(EiE2) = E(E2E|) = 0 

(5.19) 
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For a g 0.8 

e(Eo 2) a 8.6039 60396 Oe 2 (5.20) 

e(Ei2) s 7.8211 99167 (5.21) 

E(E22) a 7.0652 982<19 Oe2 (5.22) 

e(EoE 2) a e(E 2 Bo) a -0.67000 73131 (5.23) 

E(BoEi) a e(BiEo) a e(EiB 2 ) = e(E 2 Ei) a 0 (5.2^1) 

For a = 0.9 

e(Eo 2) a 17.217 86439 Og2 (5.25) 

e(Ei2) - 13.841 98613 (5.26) 

e(B 22) a 10.933 27966 (5.27) 

e(EoE 2) a b(E 2 Eo) a -2,1591 29562 OgS (5.28) 

e(EoEi) = E(EiEo) a e(EiE 2) a e(e 2 Ei) a 0 (5.29) 

For a a 0,99 

e(Eo 2) a 73.999 66291 (5.30) 

e(Ei2) = 13.714 80539 (5. 3D 

e(E 22) a 4.5863 43888 (5.32) 

e(EoE 2 ) a e(E 2 Eo) a '-4.6841 13901 ae2 (5.33) 

e(EoEi ) = e(EiEo) a e (EiE 2) a eCe2Ei ) a 0 


(5.34) 


For a s 0.999 

8OFMI9 

E(Bo2) s 97.682 52696 Oe^ 

(5.35) 

E(Ei2) s 1.9576 74533 ag2 

(5.36) 

E(E22) X 0.48584 40305 

(5.37) 

E(BoE2) s E(E2Bq) s - 0.72319 19335 ag2 

(5.38) 

E(EoEi) X E(EiEo) * E(EiE 2) = E(E2Ei) x 0 

(5.39) 

For a = 1 


E(Eq2) X 101 Og2 

(5.40) 

E(Ei 2) = 0 

(5.41) 

E(E22) 0 

(5.42) 

E(EoE2) = E(E2Eq) = 0 

(5.43) 

E(EqEi) = E(BiEo) = E(EiE 2) s E(E2 Ei) s 0 

(5.44) 


From equation 4.26, for a second order fit, the accuracy of is given by 

^((?n “ Fn)^) * To2e(Eo2) + Ti2e(e|2) 4. T22e(E22) 

+ 2Tof|E(EoEi) + 2fiT2E(E|E2) 2 ToT2E(EoE2) 

But 

E(EoE|) = E(EiE 2 ) = 0 
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E((yn - yn)2) >c To2®^Bo2) Ti2e(bi2) ♦ T22e(E22) 

+ 2ToT2E(EoE2) (5.1<5) 

where 

To » 1/V»r (5-46) 


Ti s ill _1-.Cn f 1 . 2n) (6.47) 

\N ypTi 


?2 s ^ ^ 1)(N 4 2) - 6(N 4- 1)n 4- 6n2) 

VN \(n2 - 1)(n2 - 4) ' (5.48) 


Table 5-1 shows the accuracy of yn at the end points of n s 1 and n * N for 
various values of a. Note that Ns 101 and a second-order fit is used. Table 

5-11 shows the accuracy of y^ at the midpoint of n * (N 4- 1)/2 s 51 for various 
values of a. Note that a s 1 is for a constant-bias error. 
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TABLE 5-1.- ACCURACY OF yi AND yini FOR A 
SECOND-ORDER FIT AND N a 101 

a 

- yi)^) * ^((yioi - yioi)^) 

0 

0.29270 oe 

0.4 

.43665 Oe 

.8 

.78341 Oe 

.9 

.99538 Oe 

.99 

1.06989 Oe 

• 999 

1.00784 Oe 

1 

1 Oc 


TABLE 5-II.- ACCURACY OP ygi FOR A 
SECOND-ORDER FIT AND N s 101 


a 

^E((y5i - y5,,)2) 

0 

0.14927 Oe 

0.4 

.22677 Oe 

.8 

.43300 og 

.9 

.59467 Oe 

.99 

.94507 Oe 

.999 

.99458 Og 


1 ae 


1 
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The results shown in tables 5-1 and 5-II indicate that increasingly correlated 
noise decreases the accuracy of the fit. This is not unexpeoted, However « the 
large amount cm degradation is surprising. Prom table 5-1 » it is seen that if 
a > 0.9t the fit error is greater than that using the raw data. This is so sur- 
prising that the equations leading to this result were double checked. No 
error was found. The calculator used (a Texas Instruments 59) had 13 decimal 
digits of internal accuracy, so it is believed that roundoff error was negligible. 

Correlated error also affects the equation used to compute the standard devia- 
tion of the noise. From equation M.37» for a second order fit, 


* N I 

E 1 V = No 2 . e(Eo2) - E(Ei2j - E(E22) (5.<I9) 

n=T 


If a = 0, unoorrelated noise, 


E(Eo2j = E(Ei2j = e(B22) = ^^2 


and 



:ir’n2 

n=l 


/(N - 3) 


(5.50) 


The equations for other values of a, for N = 101, are shown in table 5-I1I. 
Note that for a = 1 , theoretically 

N 

I‘’n2 = 0, 

n=1 


thus 


0^2 _ 0/0, as shown in the table. 


TABLE 5-III.- EQUATIONS FOR OgS FOR A 
SECOND-ORDER FIT AND N = 101 
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E S 

ns1 


E 2»’n^ 
n=1 


E I J 


E /59.0 

n=1 


E /8.7O 

n=1 


E Srn^ /0.873 
n=1 


E S Pjj2 /o 

n=1 
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6.0 NUMERICAL EXAMPLES 


A numerical example with correlated noiae will be considered first. A second- 
order fit will be made with N s 101 total fit points. The true value, y^, 
will be chosen to be zero. 


yn = 0 


( 6 . 1 ) 


■ 

The noisy measurements, y|], will be given by 


yj = yn 


( 6 . 2 ) 


Table 6-1 shows n, yn, yn = ®n» yn “ yn = yn roaidual rn = yn - yn* 

The actual statistics of £n are (the bar signifies average value) 


Gn = 0.027 

oe = 0.99 

^ = ^n^n-1^‘^G^ ~ 0.89 


The Fourier coefficients were 


A 

Ao = Eo = 0.27273 96938 

A 

Ai = E-i = -e.iijin 75^178 

A 

A2 = E2 = -2.^988 18869 


Higher-order fits were also made by the computer program and may be of interest. 


A3 = E3 = 4.3008 65931 

A 

All = Ei| = -0.47203 26435 

A 

A5 = E5 = 1.7513 69813 
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(6.3) 

(6.4) 

(6.5) 
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Ag = E6 = 1.1905 86888 

A 

A7 = E7 = -0.«195^0 58757 


As = Ea = -0.18221 1059^1 


A 

From Aq» 


A A 

Ai find A2 may be computed 


Yn = -1.6150 62680 + 0.05^133 34609n - 0.00032 70951n2 


( 6 . 6 ) 


The residual statistics are 


® = 0*77 (actual value O.89) 



(for a = 0) 


(for a = 0.77) 


(for a = 0.9) 


(6.7) 

( 6 . 8 ) 


(6.9) 


( 6 . 10 ) 


It is seen from table 6-1 that the residuals are, in general, not a very accu- 
rate representation of when the noise is strongly correlated. However, 

A 

% = 0.97 (actual 0.99) is an excellent estimate when using a = 0.9. However, 
one has no way of knowing that a is this large and must use a = 0.77, which 

; A 

gives Ug = 0.84, which is low but is still a ”ball park'* answer. 
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TABLE 6 

-I.- SECOND-ORDER FIT RESULTS FOR 

a s 0.9 

n 

yn 

■ 

yn * Yn + En 

Yn = Yn " Yn 

‘’n * Yn “ Yn 

1 

0 

0 

-1.5611 

1.5611 

2 

0 

-0,3494 

-1.5077 

1.1583 

3 

0 

-.3984 

-1.4550 

1.0566 

4 

0 

-.4170 

-1,4030 

0.9860 

5 

0 

-.1493 

-1.3516 

1.2023 

6 

0 

-1,1816 

-1.3Q08 

.1192 

7 

0 

-.9308 

-1.2508 

.3200 

8 

0 

-1.3124 

-1.2013 

-.1111 

9 

0 

-1.5577 

-1.9628 

-.4051 

10 

0 

-1.2187 

-1.1044 

-.1143 

11 

0 

-1.3775 

-1.0570 

-.3205 

12 

0 

-1.9545 

-1.0102 

-.9443 

13 

0 

-2.2164 

-0.9640 

-1.2524 

14 

0 

-1.7793 

-.9185 

-.8608 

15 

0 

-.9189 

-.8737 

-.0452 

16 

0 

-.3002 

-.8295 

.5293 

17 

0 

-.3919 

-.7859 

.3940 

18 

0 

-.3126 

-.7430 

.4304 

19 

0 

.0943 

-.7008 

.7951 

20 

0 

-.7876 

-.6592 

-.1284 

21 

0 

-1.1708 

-.6183 

-.5525 

22 

0 

-1.1993 

-.5780 

-.6213 

23 

0 

-1.9765 

-.5384 

-1.4381 


‘*2 





TABLE 6-1,- Continued 


80FM19 


n 

Vn 

yU * yn + 

A A 

yn = yn - yn 

»’n * yU 

2^1 

0 

-1.9837 

-0.4995 

-1.4842 

25 

0 

-2.3802 

-.4612 

-1.9190 

26 

0 

-1.21193 

-.4235 

-0.8258 

27 

0 

-1.8161 

-.3865 

-1.4296 

28 

0 

-0.9532 

-.3502 

—.6030 

29 

0 

-.2960 

-.3145 

.0185 

30 

0 

.11600 

-.2794 

.7394 

31 

0 

.11114 

-.2451 

.3595 

32 

0 

.6317 

-.2113 

.8430 

33 

0 

.7114 

-.1783 

.8897 

311 

0 

.4601 

-.1458 

.6059 

35 

0 

-.0068 

-.1141 

.1073 

36 

0 

.3144 

-.0830 

.3974 

37 

0 

.2466 

-.0525 

.2991 

38 

0 

-.6742 

-.0227 

-.6515 

39 

0 

-.3556 

.0064 

-.3620 

i»o 

0 

.0802 

.0349 

.0453 

in 

0 

-.3638 

. 0628 

-.4266 

i|2 

0 

-.9590 

.0899 

-1.0489 

i|3 

0 

-.7855 

.1165 

-.9020 

H4 

0 

-.1741 

.1424 

-.3165 

i»5 

0 

-.3331 

.1676 

-.5007 

i1i6 

0 

-.4284 

. 1921 

-.6205 


^3 
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TABLE 6-1.- Continued 


n 

Xn 

Vn - Vn ♦ 6n 

A 

yn * Vn - yn 

^n = yj - ?n 

^7 

0 

-0.4398 

0.2161 

-0.6559 


0 

.1712 

.2393 

-.0681 

^<9 

0 

-.4064 

.2619 

-.6683 

50 

•7 

.0252 

.2839 

-.2587 

51 

0 

-.0035 

.3052 

-.3087 

52 

0 

.6642 

.3258 

.3384 

53 

0 

.5888 

.3458 

.2430 

5^1 

0 

.5507 

.3651 

. 1856 

55 

0 

.9769 

.3838 

.5931 

56 

0 

1.0063 

.4018 

.6045 

57 

0 

.6205 

,4192 

.2013 

58 

0 

1.0289 

.4359 

.5930 

59 

0 

1.3180 

.4520 

.8660 

60 

0 

.5744 

.4674 

.1070 

61 

0 

-.2250 

.4822 

-.7072 

62 

0 

-.5212 

.4963 

- 1.0175 

63 

0 

-.8818 

.5097 

-1.3915 

64 

0 

-.1793. 

.5225 

-.7018 

65 

0 

.4494 

.5346 

-.0852 

66 

0 

.8959 

.5461 

.3498 

67 

0 

1.0487 

.5569 

.4918 

68 

0 

.8538 

.5671 

.2867 
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TABLE 6-1,- Continued 


n 

Yn 

Yn * Yn + 

A A 

Yn * Yn - Yn 

**n * Yn " Yn 

70 

0 

1.2763 

0.5855 

0.6908 

71 

0 

0.9610 

.5937 

.3673 

72 

0 

1.5397 

.6013 

.9384 

73 

0 

1.5644 

.6082 

.9562 

74 

0 

1.0447 

.6144 

.4303 

75 

0 

1.0691 

.6200 

.4491 

76 

0 

1.0992 

.6250 

.4742 

77 

0 

1.5997 

.6293 

.9704 

78 

0 

1.3414 

.6329 

.7085 

79 

0 

1.7311 

.6359 

1.0952 

80 

0 

1.6476 

.6382 

1.0094 

81 

0 

.7782 

.6399 

.1383 

82 

0 

1.0475 

.6409 

.4066 

83 

0 

1.0863 

.6413 

.4450 

84 

0 

.9385 

.6410 

.2975 

85 

0 

1.1995 

.6400 

.5595 

86 

0 

1.4800 

.6384 

.8416 

87 

0 

1.1382 

.6362 

.5020 

88 

0 

.8963 

.6333 

.2630 

89 

0 

.9855 

.6297 

.3558 

90 

0 

.9773 

.6255 

.3518 

91 

0 

.8827 

.6206 

.2621 


TABLE 6»I.> Concluded 
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Table 6-IX shows the results of a second-order fit for N s 101 when a s 0, 
unoorrelated noise. The actual statistics of were (the bar signifies 
average value) 


en * 0 


(6.11) 


Oe = 1-01 

(6.12) 

a = e7 

en-i/cfe^ “ -0.02 

( 6 . 13 ) 


The Fourier coefficients were 

A 

Ao s Eq = 0 

At = El = -0.7^739 39138 
Ag 5 E2 = -1. 882^1 00360 
A 3 = E 3 = 0.84175 25686 
Air = B 4 s -0.61177 60429 
A 5 s E 5 = 0.22788 77925 
A6 s Eg = 0.39771 81088 
A 7 = E 7 = 0.45247 92538 
Ag = Eg = -0.19762 51796 

Let the left subscript indicate the order of the fit. Then 


“Il'^n^ a = 0) 
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I® * 


(6.15) 


Based on the residuals from various order fits, 


A 

S 1.01 

^a * -O.03 

A 

gO g s 1 ♦ 00 

2. T! -0.06 

A 

A 

^00 1 • 00 

ja s -O.07 

A 

ijOc S 1*01 

i|a s -0.08 

A 

gOc s 1.01 

5a s -0.08 

A 

ga0 s 1,02 

ea = -0.08 

A 

yO0 » 1*02 

A 

•jra s — 0.08 

A 

g00 s 1 . 03 

8a s -0.08 


There are very good b^ttfr rsrimftrof 

r'^’^than ihen a = 0 '% as in table 6-1. Using figure 6 for a second-order fit, 
and using table 6-II, it is seen that 


>/e((Ji - yi)2) = 0.295 

•^E((yioi - = 0.295 

VE((y51 - YSl)^^ = 

\E((y27 - 0.135 

I T. " 

VElCyyH “ 774 )^ J = 0*’'35 


(actual error s -0.53) 
(actual error = -0.28) 
(actual error = 0.21) 
(actual error = 0.01) 


(actual error s 0.14) 
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TABLE 6-II.- SECOND-ORDER PIT RESULTS FOR « » 0 


n 

yn 

y* * yn + en 

yn * yn ■ yn 

• A 

•'n ® yn ” yn 

1 

0 

0 

-0.5342 

0.5342 

2 

0 

-0.7645 

-.5072 

-.2573 

3 

0 

-.1547 

-.4808 

.3261 

4 

0 

-.0955 

-.4548 

.3593 

5 

0 

.5421 

-.4294 

.9715 

6 

0 

-2.3196 

-.4044 

-1.9152 

7 

0 

.3672 

-.3799 

.7471 

8 

0 

-1.0032 

-.3559 

-.6473 

9 

0 

-.7666 

-.3324 

-.4342 

10 

0 

.4976 

-.3094 

.8070 

11 

0 

-.5562 

-.2869 

-.2693 

12 

0 

-1.5204 

-.2649 

-1.2555 

13 

0 

-.9188 

-.2434 

-.6754 

14 

0 

.5991 

-.2223 

.8214 

15 

0 

1.6247 

-.2018 

1.8265 

16 

0 

1.2377 

-.1817 

1.4194 

17 

0 

-.2415 

-.1622 

-.0793 

18 

0 

. 1250 

-.1431 

.2681 

19 

0 

.8721 

-.1246 

.9967 

20 

0 

-1.9373 

-.1065 

-1.8308 

21 

0 

-.9830 

-.0889 

-.8941 

22 

0 

-.2559 

-.0718 

-.1841 

23 

0 

-1 .9367 

-.0552 

-1.8815 


49 
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TABLE 6-II.- Continued 


n 

yn 

i 

yn * yn + 

yn * yn - yn 

^n = yj - ?n 

24 

0 

-0.3525 

-0.0391 

-0.3134 

25 

0 

-1.2250 

-.0235 

-1.2015 

26 

0 

1,9110 

-.0064 

1.9194 

27 

0 

-1.4747 

.0063 

-1.4810 

28 

0 

1.b237 

.0204 

1.6033 

29 

0 

1.3178 

.0340 

1.2838 

30 

0 

1.6566 

.0472 

1.6094 

31 

0 

-.6736 

.0598 

-.7334 

32 

0 

1.1957 

.0720 

1.1237 

33 

0 

.3091 

.0837 

.2254 

34 

0 

-.4176 

.0948 

-.5124 

35 

0 

-.9450 

.1055 

-1.0505 

36 

0 

.7353 

.1157 

.6196 

37 

0 

-.0781 

. 1254 

-.2035 

38 

0 

-1.9991 

. 1346 

-2. '1337 

39 

0 

.6100 

. 1433 

.4667 

40 

0 

.9293 

.1516 

.7777 

41 

0 

—.9619 

.1593 

-1.1212 

42 

0 

-1 . 3799 

. 1665 

-1.5464 

43 

0 

.2342 

.1733 

.0609 

44 

0 

\. 2 )m 

.1795 

1.0657 

45 

0 

-.3694 

.1853 

-.5547 

46 

0 

-.2553 

.1905 

-.4458 




T 
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TABLE 6-II.- Continued 


n 

yn 

yn = yn 

M7 

0 

-0.0848 

48 

0 

1.3064 

49 

0 

-1.2447 

50 

0 

.9108 

51 

0 

-.0421 

52 

0 

1.5114 

53 

0 

-.0323 

54 

0 

.0377 

55 

0 

1.0702 

56 

0 

.2583 

57 

0 

-.6658 

58 

0 

1.0427 

59 

0 

.8489 

60 

0 

-1.4108 

61 

0 

-1.6689 

62 

0 

-.6857 

63 

0 

-.8829 

64 

0 

1.4321 

65 

0 

1.3926 

66 

0 

1.0972 

67 

0 

.5201 

68 

0 

-.2309 

69 

0 

1.917,5 


A 

» yn ’ yn 

•"n * yn ” yn 

0.1953 

-0.2801 

.1996 

1.1068 

.2034 

-1.4481 

.2066 

.7042 

.2094 

-.2515 

.2118 

1.2996 

.2136 

-.2459 

.2149 ■ 

-.1772 

.2157 

.8545 

.2160 

.0423 

.2159 

-.8817 

.2152 

.8275 

.2141 

.6348 

.2125 

-1.6233 

.2103 

-1.8792 

.2077 

-.8934 

.2046 

-1.0875 

.2010 

1.2311 

.1969 

1.1957 

.1923 

.9049 

.1872 

.3329 

.1816 

-.4125 

.1756 

1.7419 . 
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TABLE Continued 


n 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 


yn 


0 

0 

0 

0 

.. 0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


• 

A A 


n * yn ^ Cn 

yn s yn - yn 

*’n * y j - in 

- 0.4912 

0.1690 

- 0.6602 

-.4598 

.1619 

-.6217 

1 .4848 

.1544 

1.3304 

.3486 

.1463 

.2023 

-.8655 

.1378 

- 1.0033 

.2591 

.1288 

.1303 

.2764 

.1193 

.1571 

1.3345 

.1092 

1.2253 

-.2742 

.0987 

-.3729 

1.1301 

.0877 

1.0424 

.1405 

.0762 

.0643 

- 1.6334 

.0643 

- 1.6977 

.7596 

.0518 

.7078 

.2921 

.0388 

.2533 

-.1190 

.0253 

-.1443 

.7698 

.0114 

.7584 

.8602 

-.0031 

.8633 

-.4826 

-.0180 

-.4646 

-.3199 

-.0334 

-.2865 

.3776 

-.0494 

.4270 

. 1758 

-.0658 

.2416 

.0192 

-.0827 

.0635 

.8927 

-.1001 

-.7926 
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TABLE 6-II.- Concluded 


n 

yn 

yn * yn ♦ en 

yn - yn - yn 

**n * yn " yn 

93 

0 

-1.4867 

-0.1180 

-1.3687 

9'< 

0 

1.0384 

-. 1364 

1.1748 

95 

0 

-1.1175 

-.1553 

-0.9622 

96 

0 

.4124 

-.1747 

.5871 

97 

0 

-.0061 

-.1945 

.1884 

98 

0 

1.3344 

-.2149 

1.5493 

99 

0 

-1.0373 

-.2358 

-.8015 

100 

0 

-1.7857 

-.2571 

-1.5286 

101 

0 

-.4479 

-.2789 

-.1690 
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7.0 CONCLUSIONS 


Discrete Tchebycheff orthonorinal polynomials offer a convenient way to make 
least-squares polynomial fits of uniformly spaced discrete data. Computer pro- 
grams to do so are simple and fast, and appear to be less affected by computer 
roundoff error, for the higher-order fits, than conventional least-squares 
programs . 

When analyzing noisy data to obtain the error statistics, use the lowest-order 

A 

fit that is "adequate.” One way to ascertain this order is to examine lOg to 
find the first two values of I (the fit order) that give similar results. The 
lower value will be adequate. Probably the best way to obtain accurate resid- 
uals for generating error statistics is to use the midpoint residuals of a 
sliding polynomial fit of order 0, 2, 4, or 6, etc. Note that the results 
are identical to those with fits of 1 , 3, 5, or 7, etc. For example, if a 
second-order midpoint fit is not adequate, then a fourth-order fit must be tried 
since a third-order fit will not alter the value of a midpoint residual. 

For real-time polynomial smoothing (filtering), try to avoid using the endpoint 
(n = N) estimate. Estimates a short way from the end of the interval can double 
the accuracy, particularly if derivatives are needed. Again, the lowest-order 
adequate fit should be used. 

In section 5.0, it was seen that exponentially correlated noise can greatly de- 
crease the fit accuracy. In fact, a very surprising result was obtained. If 
the errors adding to the data are very strongly correlated, it is possible that 
the end point fit error standard deviation can be worse than that using the raw 
data. 
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